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Abstract — The open problem of calculating the limiting spec- 
trum (or its Shannon transform) of increasingly large random 
Hermitian finite-band matrices is described. In general, these 
matrices include a finite number of non-zero diagonals around 
their main diagonal regardless of their size. Two different com- 
munication setups which may be modeled using such matrices are 
presented: a simple cellular uplink channel, and a time varying 
inter-symbol interference channel. Selected recent information- 
theoretic works dealing directly with such channels are reviewed. 
Finally, several characteristics of the still unknown limiting 
spectrum of such matrices are listed, and some reflections are 
touched upon. 



I. Problem Description 



Consider a linear channel of the form 



y — H nx + z 



(1) 



where x is the NK x 1 zero-mean complex Gaussian input 
vector x ~ £/V(0, £Ink) 0, y is the iV x 1 output vector, 
and z denotes the N x 1 zero-mean complex Gaussian additive 
noise vector z ~ CA/*(0, Ink), which is independent of x 
and Hfq- Accordingly p = is the transmitted signal-to- 
noise ratio (SNR). In addition, the N x NK channels transfer 
matrix H pf is defined by 
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(2) 



where {a,;, bi, c,} are statistically independent 1 x K random 
row vectors with independent identically distributed (i.i.d.) 
entries <2jj ~ 7r a , bij ~ 7Tb, and Cjj ~ ir c . For simplicity, 
we assume that the power moments of the entries for any 
finite order are bounded. Finally, a, j3 S [0, 1] are constants. 

The normalized input-output mutual information of ([TJ 
conditioned on H # (also known as the Shannon transform) 



'An N X N identity matrix is denoted by Ij\ 



jjI(x;y\H N ) = ^logdet (l N + P H N H\ 
1 N 
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where Xi(H H' N ) denotes the ith eigenvalue of the Hermi- 
tian five-diagonal matrix Jfjyff L, Furthermore, denoting the 
indicator function by !{•}, 



1 



(4) 



is the empirical cumulative distribution function of the eigen- 
values (also referred to as the spectrum or empirical distribu- 
tion) of HjfHjf. Fixing K and assuming that F H[<H t (x) 
converges almost surely (a.s.) to a unique limiting spectrum 
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F(x), it can be shown that the expectation 



of (O with respect to (w.r.t.) the distribution of H m converges 
as well. This is since (O is uniformly integrable due to the 
Hadamard inequality and the bounded power moment assump- 
tion, and hence the a.s. convergence implies convergence in 
expectation [1]. 

In Section [XT] it will be realized that if the channel is 
known at the receiver and its variation over time is stationary 
and ergodic, then the expectation of (O w.r.t. the distribution 
of H n is the per-cell sum-rate capacity of a certain cellular 
uplink channel model. In another setting (see Section |n), the 
same expectation may be interpreted as the capacity of a 
certain time variant inter-symbol interference (ISI) channel, 
assuming again that the channel is known at the receiver. 

A. Analytical Difficulty 

Many recent studies have analyzed the asymptotic rates 
of various vector channels using results from the theory of 
(large) random matrix (see [2] for a recent review). In those 
cases, the number of random variables involved is of the 
order of the number of elements in the matrix Hn, and 
self-averaging is strong enough to ensure convergence of the 

2 Unless explicitly denoted otherwise a natural base logarithm is used 
throughout this presentation. 



empirical measure of eigenvalues, and to derive equations for 
the limiting spectrum (or its Stieltjes transform). In particular, 
this is the case if the normalized continuous power profile of 
Hn, which is defined with r, t G [0, 1] as 

VN(r,t)±E(\[H N ]ij\ a ) 

— < r < A Lzl <t< J- (5) 
N ~ N ' NK ~ NK ' 

converges uniformly to a bounded, piecewise continuous func- 
tion as N — > oo, see e.g. [2, Theorem 2.50]. In the case 
under consideration here, it is easy to verify that for K fixed, 
"Plaint) does not converge uniformly, and other techniques 
are required. 

Remark: It is noted that the setting of ((TJ can be extended 
in many ways such as increasing the number of non-zero 
block diagonals, or replacing each i^-dimensional random row 
vector with an n x m random matrix. Such settings result in 
HnH^ n which includes more than five non-zero diagonals 
and are referred to as Hermitian finite-band random matrices; 
the resulting matrices contain only zero entries outside a finite 
band (finite number of non-zero diagonals) around their main 
diagonal regardless of N. 

To the best of the authors' knowledge, neither the limiting 
spectrum of Hermitian finite-band random matrices, nor the 
expectation of the normalized input-output conditional mutual 
information (f3]), is known in general except for a few special 
cases (see Section ITTTii. Moreover, even the high-SNR regime 
characterization (defined in [3] [4]) of the latter is known only 
for a few special cases (see Section [TTTb and remains an open 
problem in general. 

II. Motivation 

In this section we present two different multi-access com- 
munication channels whose channel transfer matrices are 
finite-band. 

a) Cellular uplink: Motivated by the fact that a mobile 
user in a cellular system effectively "sees" only a finite 
number of base-stations, a simplified cellular model family 
has been introduced by Wyner in [5] (see also [6] for an 
independent earlier work which deals with similar setups). 
According to the original linear variant setup presented in [5], 
the K homogenous users of each cell are collocated at the 
cell's center and "see" their local base-station antenna and 
the antennas of the two adjacent base-stations only. While 
the signals travel to the local antenna with no path-loss, the 
path-losses to the adjacent cell antenna on the left and to 
the one on the right, are characterized by two parameters 
a, j3 € [0, 1], respectively. Wyner assumed that the users 
cannot cooperate in any way and that all the base-stations are 
connected to a central receiver via an ideal error-free infinite 
capacity backhaul network. With optimal joint processing of 
all the received signals, the channel can be considered as a 
multiple-access channel whose vector representation is given 
by ([T). The non-fading setup of [5] was extended to include 
flat fading channels in [7] [8]. Considering an infinite number 
of cells and assuming that the channel state information is 



known by the central receiver, the per-cell sum-rate capacity 
of the Wyner model is given by setting 7r a = 7Tb = n c = n, 
and averaging the mutual information of (01 over the entries 
of H jv- It is noted that the basic model can be extended to 
cases where each mobile "sees" any finite number of cell-site 
antennas and the resulting HnH^ n is a finite-band matrix. 
Remark: Using the uplink-downlink duality (e.g. [9]), the per- 
cell sum-rate capacity of the Wyner uplink channel is also 
an achievable per-cell sum-rate (a lower bound of the per-cell 
capacity) of the reciprocal Wyner downlink channel, assuming 
the joint multicell transmitter has full channel state information 
(CSI) while each mobile is aware of its own CSI only. 

Since its introduction in [5], the Wyner model family has 
provided a powerful framework for research assessing the 
performance of various joint multicell processing schemes (see 
[10] and [11] for recent surveys). Overcoming the analytical 
difficulties relating to these models and calculating the spectra 
(or their transforms) of the resulting finite-band matrices, 
would greatly enhance our understanding and insight into 
the theoretical performance of future cellular (and wireless) 
systems. 

b) Time varying ISI channels: Here we consider K 
homogenous users communicating with a receiver over an L- 
tap time varying ISI channel. Assuming that the channel taps 
are i.i.d. between different users and also i.i.d. in the time 
index it is easily verified that the received signal is given 
by ((TJ. Assuming that L = 3, the sum-rate of this multiple 
access channel is given by averaging the mutual information 
of (f3j) over the entries of H m- This setup may describe a 
"fast" multipath fading channel where the channel taps are 
independent over the time index. As with the previous setup 
for any finite L the resulting H^H^ is a finite-band matrix. 
In contrast to the previous model where the entries of the 
received signal are in the spatial domain, the entries of the 
received signal here are in the time domain. 

III. Selected Prior Work 

In this section we briefly review selected previous works 
dealing with the spectrum of finite-band matrices, its Shannon 
transform, and related issues. The reader is referred to [10] 
and [11] for detailed surveys of relevant information-theoretic 
works. 

The non-fading (or deterministic) case was analyzed by 
Wyner in [5] for the special case of (3 = a. Setting <Zjj = 
bi,j = c i,j = 1 we get that ^HnH' n becomes a five- 
diagonal Toeplitz matrix with non-zero entries (a 2 , 2a, 1 + 
2a 2 , 2a, a 2 ). Using well known results regarding the limiting 
spectrum of large Toeplitz matrices (Szego's Theorem [12]), 
Wyner showed that the per-cell sum-rate capacity approaches 
as N — > oo to 

C = f log (1 + P(l + 2a cos(2tt/)) 2 ) df . (6) 
J o 

It is noted that the result is independent of K as long as 
the total transmit power per-cell P is fixed. The reader is 
referred to [13] for a derivation of the Stieltjes transform of 
the spectrum for similar five-diagonal Toeplitz matrices. 



The infinite linear Wyner model in the presence of flat 
fading channels is considered in [8]. For the special case of 
(3 = a, -K a = tti, = 7r c = 7T and K = 1 it is shown that 



the unordered eigenvalue distribution E(F 



) converges 



weakly to a unique distribution. It is conjectured that using 
similar methods the spectrum can be proved to converge a.s. 
to a unique limit as well. In addition, using a standard weighted 
paths summation over a restricted grid, the limiting values of 
the first several moments of this distribution were calculated 
for the special case in which the amplitude of an individual 
fading coefficient is statistically independent of its uniformly 
distributed phase (e.g. Rayleigh fading 7r = £/V(0, 1)). For 
example, listed below are the first three limiting moments: 

Ail =1712 + 2m2a 2 
M2 =m4 + 8m 2 , a 2 + (4m 2 , + 27774) a 4 



■Ma =m 6 + (6m 2 + 12m2m4)a + (36m 2 + 12m.2m4)a 
+ (6m'2 + 12m2r774 + 2me)a 6 , 



(7) 



where rrii is the i-th power moments of the amplitude of an 
individual fading coefficient. It is noted that this procedure can 
be extended in principle, although in a tedious manner, for 
any finite K or also for Hn to include more than three non- 
zero block diagonals. Since the limiting moments of increasing 
order are functions of increasing orders of the moments of 
the fading coefficients, it is conjectured that the limiting 
distributions (and also the spectra) of finite-band matrices 
depend on the actual fading distribution and not just on its 
few first moments. Focusing on the case in which K is large 
while P is kept constant, and applying the strong law of large 
numbers (SLLN), the entries of j^HnH n consolidate a.s. to 
their mean values and the latter becomes a Toeplitz matrix. 
By applying Szego's Theorem for TV — > 00 it is shown in [8] 
that the per-cell sum-rate capacity is given by 
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where a 2 = 777,2 — \mi | 2 is the variance of an individual fading 
coefficient. 

An alternative approach which replaces the role of the eigen- 
values of HnH n with the diagonal elements of its Cholesky 
decomposition, is presented by Narula [14]. With a = 1, /3 = 
0, n a = 7Tb = ir, and K = 1, the resulting H^H N is a three- 
diagonal matrix (also known as Jacobi matrix). Originally, 
Narula has studied the capacity of a "fast" time varying two- 
tap ISI channel, where the channel coefficients are i.i.d. zero- 
mean complex Gaussian (i.e. tt = C/V(0, 1)). Following [14], 
the diagonal entries of the Cholesky decomposition applied 
to the covariance matrix [l N + PH N H^ = L n D n Un, are 
given by 



= 1+P\a n \ 2 +P\br, 



d„ 



n = 2,...,N, (9) 



with an initial condition d\ = 1 + P \a\\ + P\bi\ . Thus, 
the diagonal entries {d m } form a discrete-time continuous 



space Markov chain. Remarkably, Narula managed to prove 
that this Markov chain possesses a unique ergodic stationary 
distribution, given by 
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x > 1 



(10) 



where Ei(a;) = cxp [~^ dt is the exponential integral 
function. Further, it is proven in [14] that the SLLN holds for 
the sequence {logd„} as N — > 00, and the channel capacity 
is 

(log(a:)) 2 e~f 



C : 



[ 



Ei(i)P 



-dx 



(11) 



It is noted that Narula's approach is closely matched to the 
above setting and any attempt so far to change a key parameter 
in this setting (such as the entries' distribution, the number of 
users per-cell, and the number of non-zero diagonals) leads to 
an analytically intractable derivation. This is probably related 
to the unique properties of Jacobi matrices which does not 
apply to finite-band matrices in general. For example, the 
determinant of a Jacobi matrix is equal to a weighted sum 
of the determinants of its two largest principal sub-matrices. 
In addition, Narula's analysis provides additional evidence to 
support the conjecture that the limiting spectrum of finite- 
band random matrices is dependent on the distribution of their 
entries. On this note, in [15] an equivalent cellular uplink setup 
but with uniform phase fading ((a^l = 1 and 9i 



U[0.2n}) known at the joint receiver is considered, and the 
per-cell sum-rate capacity is shown to coincide with the non- 
fading setup for N — > 00. It is worth mentioning that the latter 
result holds only for the tridiagonal case. 

As an alternative to deriving exact analytical results, some 
works focus on extracting parameters that characterize the 
channel capacity under extreme SNR scenarios (see [3] - 
[4] for more details on the extreme SNR characterization). 
The low-SNR regime is characterized through the minimum 
transmit Eb/N that enables reliable communications, i.e., 
Eb/No min , and the low-SNR spectral efficiency slope So. As- 
suming full receiver CSI and no user cooperation, it is shown 
in [16] that the derivation of the low-SNR parameters reduces 

to the calculation of tr ^(H^Hn)^ and tr ^JT^iTjv^Y 

For example, the low-SNR parameters for the capacity of the 
Wyner setup are given for N — > 00 by [17] 



log 2 



m 2 (l + 2a 2 ) 



S = 



2K(1 + 2a 



(12) 



K + K -1+4(1 + K)a 2 + 2(fC + 2K)a A 



where the kurtosis of an individual fading coefficient is defined 
as K. = 7774/ (m 2 ) 2 . This result can be extended in a straight- 
forward yet tedious manner to general finite-band matrices. 

The high-SNR regime is characterized through the high- 
SNR slope Soo (also referred to as the "multiplexing gain") 
and the high-SNR power offset C^. Recently [1], the per- 
cell capacity high-SNR parameters for a two diagonal Hn 



(K = 1, a = 1, and (3 = 0) were calculated for N — > oo and 
rather general fading distributions: 

Soo = 1 ; = -2 max (E^ Q log 2 |x| , E nb log 2 |as|) . (13) 

The main idea is to link the spectral properties of HnH' n 
with the exponential growth of the elements of its eigenvectors. 
Since H ^H^ N in this case is an Hermitian Jacobi matrix, and 
hence is tridiagonal, its eigenvectors can be considered to be 
sequences with second order linear recurrence. Therefore, the 
problem reduces to the study of the exponential growth of 
products of two by two matrices. This is closely related to the 
evaluation of the top Lyapunov exponent of the product; The 
explicit link between the Shannon transform (0 and the top 
Lyapunov exponent is the Thouless formula [18]. Moreover, 
for arbitrary finite K, it is shown in [1] that Soo = 1 while the 
power offset is bounded by a sequence of explicit upper- and 
lower-bounds; the gap between the lower and the upper bounds 
decreases with the bounds' order and complexity. It is noted 
that calculating exact expressions for the high-SNR parameters 
of channels with general fading distribution and arbitrary 
finite K remains an open problem even for the tridiagonal 
case. In addition, (fl~3T > also further supports the conjecture 
made regarding the dependency of the limiting spectrum of 
finite-band matrices on their entries' distribution. 

Recently [13], the limiting spectrum of 1+ ^ a2 H ^ for 
the Wyner setup and complex Gaussian vectors, has been 
loosely shown by free probability tools to be approximated 
by the Maroenko-Pastur distribution with parameter K. The 
approximation, is shown to fairly well match the spectrum by 
Monte-Carlo simulations only for relatively large values of a. 
It should be emphasized that such a match is not guaranteed 
for other fading distributions excluding the complex Gaussian 
distribution (i.e. Rayleigh fading). A possible reasoning for 
the approximation inaccuracy in the low a regime is that in 
the extreme case of a = 0, the eigenvalues are evidently 
exponentially distributed, with no finite support (in contrast 
to the Maroenko-Pastur distribution). 

IV. Concluding Remarks 

The limiting spectrum (or its Shannon transform) of certain 
large finite-band Hermitian random matrices is known for a 
few limited cases and remains an open problem in general. 
Moreover, even the high-SNR characterization of their Shan- 
non transforms is still unsolved. Due to their special power 
profile, standard tools from the theory of random matrices 
cannot be used for this problem. It is conjectured that unlike 
"full" random matrices, the limiting spectra of finite-band 
random matrices depend on the actual distribution of their 
entries. It seems that unconventional methods such as the 
method used by Narula, replacing the role of eigenvalues 
with the diagonal elements of the Cholesky decomposition, 
are required to shed light on this problem. Nevertheless, it is 
noted that the tri-diagonal (Jacobi matrices) case is unique and 
these techniques may not apply to general finite-band matrices. 
Finally, we note that solving the problem would facilitate 
analytical treatment, which in turn gains much insight into the 



effect of key system parameters on the performance of certain 
cellular uplink channels and time varying ISI channels. 
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